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Abstract 



For several pairs (P, Q) of classical distributions on Nq, we show that their stochas- 
tic ordering P <st Q can be characterized by their extreme tail ordering equivalent to 
P{{k*})/Qi{k*}) > 1 > limfe^fc. P({fc})/Q({fc}), with fc* and k* denoting the min- 
imum and the supremum of the support of P + Q, and with the limit to be read as 
P{{k*})/Q{{k*}) for k* finite. This includes in particular all pairs where P and Q are 
both binomial (&ni,pi <st ^^2,^2 if only if ni < n2 and (1 — pi)"^ > (1 — ^2)"^, or 
Pi =0), both negative binomial {b~^ p^ <st K2,P2 ^'^'^ "'^^y Pi - P2 and p^^ > 
or both hypergeometric with the same sample size parameter. The binomial case is 
contained in a known result about Bernoulli convolutions, the other two cases appear 
to be new. 

The emphasis of this paper is on providing a variety of different methods of proofs: 
(i) half monotone likelihood ratios, (ii) explicit coupling, (iii) Markov chain compar- 
ison, (iv) analytic calculation, and (v) comparison of Levy measures. We give four 
proofs in the binomial case (methods (i)-(iv)) and three in the negative binomial case 
(methods (i), (iv) and (v)). The statement for hypergeometric distributions is proved 
via method (i). 
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1 Introduction 

1.1 Stochastic Ordering 

For probability measures P and Q on the real numbers, the stochastic ordering is the 
partial ordering 

P Q <^ P([x, oo)) < Q{[x, oo)) for all x € M. 

This condition is equivalent to the existence of two real-valued random variables X and Y 
with distributions P and Q, respectively, and such that X <Y almost surely. In fact, let 
Fp and Fq denote the distribution functions of P and Q, respectively, and let Fp^ and 
Fq^ be their left-continuous inverses. That is, 

Fp\t) := inf{x G M : Fp{x) > t}. 

Further, let U be uniformly distribiitcd on (0, 1). Then X := Fp'^{U) and Y := Fq^{U) 
have the desired property. Such a pair {X, Y) is called a coupling. 

Recall that P <st Q is equivalent to the condition that for any bounded and monotone 
increasing function / : M — >■ M, we have 

y^/dP < I fdQ. 

If P and Q have finite expectations, then taking f{x) = max(— n, min(a;, n)) and letting 
n ^ oo yields that P <st Q implies J xP(dx) < J xQ{dx). Thus stochastic ordering 
implies ordering of the expected values but not vice versa. 

There is a vast literature on stochastic orderings, and we only refer to [5], [10] and [11]. 

Let bn,p denote the binomial distribution with parameters n G N and p G [0, 1], let Poi^ 
denote the Poisson distribution with parameter A > and let b~p denote the negative 
binomial distribution (also known as Pascal distribution) with parameters r G (0, oo) and 
p G (0, 1]. Recall that b~p is the probability measure on No with weights 

Further, we denote by 

i>ypWW)= (^) k = (u-w)\...,B,u 

the hyper geometric distribution with parameters 5, G No and n G N with n < B + W. 
The main goal of this paper is to prove necessary and sufficient conditions for bni,pi <st 
6„2,P2, for Kupi <st b~^^p^ and for hyp^^ „^ <st ^yPB2,W2,n2 terms of the parameters 
ri,r2,ni,n2,pi,P2,Bi,Wi,B2,W2. 
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Since stochastic ordering implies ordering of expectations, 6ni,pi <st &n2,P2 implies pini < 
P2n2, but this condition is not sufficient for 6ni,pi ^st &n2,P2- However, if n := ni = n2, 
then 

bn,pi <st K,p2 Pi < P2- (1-1) 

There are various proofs of this statement, the simplest being a coupling: Let Ui, . . . ,Un 
be i.i.d. random variables that are uniformly distributed on [0, 1]. For z = 1, 2, let 

Ni = #{k : Uk < Pi}. 

Then Ni ^n-pi cind Ni < N2 almost surely. In Section 3 we present a more involved 
coupling proving the sufficiency of a characterization of bni,pi <st &ra2,P2 ^■Iso when rii ^ n2- 



1.2 The Likelihood Ratio Order 



Before we come to the statement of the main theorem of this article let us briefly discuss 
a stronger notion of ordering of two probability measures on M, the so-called monotone 
likelihood ratio order. Let n be any cr-finite measure such that P and Q are absolutely 
continuous with respect to /i and // is absolutely continuous with respect to P + Q. Fur- 
thermore, define the respective densities 

. dP dQ 

f = -r 9 = -T-- 

ajjL aji 

P is said to be smaller than or equal to Q in the monotone likelihood ratio order (P <ir Q) 
if there exist versions of / and g such that the likelihood ratio 

fix) 

X I-)- l{x) := —— is monotone decreasing. (1.2) 

Note that the ordering does not depend on the choice of jj,; in particular, f^ = P + Q is 

possible. 

It is well known that P <ir Q implies P <st Q but not vice versa. This will become even 
more obvious by the following characterization of the monotone likelihood ratio order. Let 
B{M.) denote the Borel cr-algebra on M. Then we have 

P<irQ ^ P{- \B) <stQ{- \B) for ah P G H(M), P(5) > 0,Q(P) > (1.3) 

by any of [6, pp. 1217-1218], [13, Theorems 1.1, 1.3] or [8, pp. 50-52]. In fact, the <S= 
implication is valid even if we replace B(R) by the class of all intervals in R (see [6]) or 
by any smaller class C of subsets of M such that for any r < s there exists an e > and a 
B e C such that [r — e,r]U[s,s + e] G P (see [13, Theorem 1.3]). In particular, if P and 
Q live on a discrete subset of M, then it suffices to check the right hand side of (1.3) only 
for sets B of cardinality 2. 

For the binomial distributions, we have bm^pi <ir ^n2,P2 ^'^d only if = or 

, , nm n2P2 ,^ 
ui < n2 and < . (1.4) 

l-pi 1-P2 
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(See [1, Theorem l(iv)] for a result for a larger class of distributions that comprises the 
binomial distributions.) In fact, if we exclude the trivial case pi = 0, then ni < n2 
is clearly necessary for 6ni,pi ^ir ^n2,P2- order to see that (1.4) is sufficient, assume 
ni < n2 and let /i and J2 be the corresponding densities, say with respect to the counting 
measure on Nq. Then ^ = /1//2 is decreasing if and only if for all fc = 0, . . . , ni — 1 

^ ^ /i(fc + l)//2(fc + l) ^ pi l-p2ni-k 
~ fi{k)/f2{k) l-pi P2 n2-k' 

Clearly, the expression on the right hand side is maximal for k = and in this case the 
inequality is equivalent to (1.4). 

As the monotone likelihood ratio order is stronger than the stochastic order, it is clear 
that (1.4) is sufficient for 6ni,pi <st ^n2,P2 but it is not necessary as we will see. 

Note that for the Poisson distribution, we have 

PoIa <st Poi/i <^=^ PoIa <ir Poi^ <^=^ A < /x. 

Hence, for this subclass of distributions, stochastic ordering and monotone likelihood ratio 
ordering coincide. 



1.3 Main Result 

For distributions P and Q on Nq, the likelihood ratio i = f/g (see (1.2)) is given by 

£{k) := P{{k})/Q{{k}), k e No. Let 

k^ := mm{{k : (P + Q){{k}) > 0}) and A:* = sup{{k : (P + Q){{k}) > 0}). (1.5) 

If k* = 00, define £{k*) := \im.swpi^_^^i{k), £{k*) := liminffe_^oo^(^) and the extreme 
right tail ratio 

,. P({k,k + 1,...)) 

If k* < 00, define g := £{k*). Note that £{k*) < q< t{k*). In order that P <st Q holds, 
it is clearly necessary that 

l{k^) > 1 (1.7) 

and 

Q<1. (1.8) 

Clearly, (1.8) is implied by 

l{k*) < 1. (1.9) 

We say that (P,Q) fulfills the left tail condition if (1.7) holds and the right tail condition 
if (1.9) holds. 

While we have just argued that (at least if A;* < 00 or if i{k) converges as A; — >■ 00) both 
tail conditions are necessary for P <st Q, the next theorem shows that for certain classes 
of distributions, the tail conditions (1.7) and (1.9) are in fact equivalent to P <st Q- 
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Theorem 1 In each of the following seven cases we have Pi <st P2 if ind only if the left 
and right tail conditions hold. 

(a) Binomial distribution. Pi = brn,pi with pi G (0, 1), G N, i = 1, 2. 
Left tail condition: 

(i-Pir>(i-P2r- (1-10) 

Right tail condition: 

ni<n2. (1.11) 

(b) Negative binomial distribution. Pi = with Vi > 0, pi E (0, 1], i = 1,2. 

Left tail condition: 

pV>p7. (1.12) 

Right tail condition: 

Pi<V2- (1.13) 

(c) Hypergeometric distribution. Pi = ^'yVBi,Wi,ni Bi,B2,Wi,W2,ni G No, 
Bi + Wi > Hi > 1, i = 1,2. Furthermore, assume that 

B2 + W2>Bi + Wi (1.14) 

or 

{m, Bi, 712 - W2 - 1} n {n2, B2, ni-Wi-l}^ 0. (1.15) 

Define 

fc^ = (m - H^i)+ A (n2 - W^2)"^ and k* = {ni A Bi) W {n2 A B2) . 
Left tail condition: 

,Wi,ni ,W2,n2 

{{h}). (1.16) 

Right tail condition: 

(d) Hypergeometric versus binomial. Pi = hyPB^vK,m; -^2 = bn,p with B, W,m,n G N, 
B + W > m, and p G (0, 1] . Left tail condition: 

'')/(''^'')>(i-,r. (1.18) 

m J I \ m J 
Right tail condition: 

mAB < n. (1.19) 

(e) Binomial versus hypergeometric. Pi = bm,p, P2 = ^yPB,w,m' B,W,m G 
No, B + W > m > 1, and p G [0, 1]. Right tail condition: 

Left tail condition: Is implied by the right tail condition. 
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(f) Binomial versus Poisson. Pi = bn,p, P2 = Poia with n G N, p G [0, 1] and A > 0. 
Left tail condition: 

{l-pT>e-^. (1.21) 
Right tail condition: Trivially fulfilled. 

(g) Poisson versus negative binomial. Pi = Poi\, P2 = b~p with p G (0,1) and 
r, A > 0. Left tail condition: 

> f. (1.22) 

Right tail condition: Trivially fulfilled. 

For (a), it is obvious that (1.10) is the left tail condition and (1.11) is right tail condition. 

For (b), (1.12) is obviously the left tail condition since ?'ri,pi({0}) =pp. For the right tail 
condition, note that for A; G N, we have 

(T)|=ri('+^)s«^(''-s:T)s^-*"- 

^ ^ 1=1 1=1 

Hgiic6 

log(V„p,({fc,fc + !,•••})) , ,^ . 
hm '-^ ; = log(l - Pi) 

and the right tail condition (1.8) is equivalent to pi > p2. 

For (c) note that fc* and k* are the minimum and maximum of the support of hyp^^ j^-^ „ + 
hyp^2 B2 n' respectively. Furthermore, note that in the case n := ni = 712, condition (1.15) 
is satisfied. In this case the left tail condition simplifies to 

Bi + Wi~ n\ fB2 + W2\ ^ (B2 + W2-n\ (Bi + Wi\ 

Bi-h )\ B2 J -\ B2-K )\ Bi J ^ - ' 

and the right tail condition becomes 

Bi + Wi- n\ /B2 + W2\ ^ fB2 + W2~n\ /Bi + Wi\ ^4) 
Bi — k* J \ B2 J ~ \ B2 — k* J \ Bi J 

For (d), (e), (f) and (g), the statements are (almost) trivial. In particular, (d) is a 
consequence of (c) since bn,p is the limit of hypj^^j „ as iV — >■ 00 and for sufficiently 

large N, condition (1.14) is satisfied. Taking a further limit wc recover (a). Similarly, (e) 
can be inferred from (c) noting that condition (1.15) is satisfied. In Section 2 we give the 
short proofs though, in order to demonstrate the flexibility of our Method 1, described 
below. 

Part (a) of the theorem is not trivial but is not new either. However, in this paper we give 
new and elementary proofs using different methods. 

Method 1 is based on likelihood ratio considerations. We show in Proposition 2.3 that the 
left and right tail condition are sufficient for stochastic ordering whenever the likelihood 
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ratio ^ or 1/^ is a unimodal function; that is, if i is either first monotone increasing and then 
monotone decreasing or vice versa. In this case we say that P and Q have half-monotone 
likelihood ratios. 

Method 2 works for the binomial distribution only and relies on an explicit coupling of 
two random variables A^j ~ ^ni,pii ^ — 1; 2, such that ^ A^2 almost surely. 

Method 3 also works for the binomial distribution only. Similarly to Method 2, this 
method is based on the observation that hn,^ can be represented as the number of nonempty 
boxes when we throw a certain random Poisson number of balls into n boxes. Unlike in 

Method 2, here we do not construct an explicit coupling of A^^i and N2 but give a stochastic 
comparison of the Markov dynamics of subsequently throwing the balls. 

Method 4 works for the binomial and negative binomial distribution and relies on ex- 
plicitly calculating the changes when we modify the parameter -p continuously. 

Method 5 uses infinite divisibility of the negative binomial distribution to give a proof 
for part (b). 

1.4 Organization of the Paper 

In Section 1.5 wc provide a brief review on stochastic order ings of Bernoulli convolutions. 
In Sections 2 - 6, we give proofs of Theorem 1 using the different methods presented above. 

1.5 A Review on Bernoulli Convolutions 

We give a brief review on a result concerning the stochastic ordering of Bernoulli convo- 
lutions (that comprises part (a) of our Theorem 1) due to Proschan and Sethuraman [7]. 
Fix n G N and let 



Let p G A„ and let Xi,...,Xn be independent random variables with P[Xj = 1] = 
1 — P [Xi = 0] = Pi. Then the distribution oi Xi + . . . + X„ is said to be the Bernoulli 

convolution BCp with parameter p. 

Let p, q G A„. By [7, Corollary 5.2] for BCp <st BCq, it is sufficient that 



By the obvious symmetry in the problem (changing the roles of the ones and zeros), it is 
also sufHcient to have 



A„ = {p = {pi, pn) e[0,ir : Pl>P2>...> Pn}- 



k k 

n — n for all k = 1, . . . ,n. 

i=i i=i 



(1.25) 



n n 



11(1 - pj) > - f^'^ all A; = 1, . . . , n. 



(1.26) 



j=k j=k 
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Note that (1.25) and (1.26) are in fact not equivalent. 

Assume ni,n2 < n and = . . . = = . . . = p„ = 0, q'l = . . . = ^na; Qni+i = 

. . . = g„ = 0. Then (1.26) is equivalent to ni < n2 and (1 — pi)"^ > (1 — qi)""^- Hence 
Theorem 1(a) is a special case of the result of [7]. 

A special case of [7, Corollary 5.2] (which is still more general than our Theorem 1(a)) 
was investigated independently of Proschan and Sethuraman by Ma [4]. Ma states [4, 
Theorem 1] that if q G A„ and p £ (0, 1), then 

BC^<,tbn,p ^ 6„,p({0}) < 5Cq({0}). (1.27) 

In fact, the condition on the right hand side of (1.27) is (1.26) (with the roles of p = 
{p, . . . ,p) and q interchanged). Again, by the obvious symmetry, this statement is equiv- 
alent to 

bn,p <st 5Cq ^ bn,p{{n}) < SCq({n}). (1.28) 

Since the hyper geometric distribution is a Bernoulli convolution (see [12]), Theorem 1(d) 
and (e) could be inferred from (1.27) and (1.28). A limiting case of (1.27), more general 
than the present Theorem 1(f), was given in [2, (A.5)]. 

2 Method 1: Half Monotone Likelihood Ratios 

In this section we provide a criterion which, together with the left and right tail condition 
(see (1.7) and (1.9)) is sufficient for stochastic ordering. We first present this method in 
the general situation and then apply it to all seven cases (a) - (g) of Theorem 1. 

2.1 A Special Criterion for the Stochastic Order 

Definition 2.1 Let P, Q be as in Section 1.2. Define the set % of pairs {P,Q) such that 
there exists a version i of the likelihood ratio (dP/d(P + Q))/{dQ/d{P + Q)) with the 
following properties: 

(i) There exists an G M such that i is monotone (increasing or decreasing) on 
(— c>D,xo] and is monotone on [xo,oo). 

(a) The left tail and right tail coniditions hold: 

lim e{x) > 1 (2.1) 

and 

lim £{x) < 1. (2.2) 

x^oo 

If only (i) is fulfilled, then we write P ~hmir Q and say that P and Q have a half monotone 
likelihood ratio. 
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Remark 2.2 For distributions P and Q on No, the quotient f /g in Definition 2.1 is the 
Hkelihood ratio £{k) := P{{k})/Q{{k}), k G Nq. In this case for P ~hmir Q it is sufficient 
that 



Note that the relation ~hmlr is symmetric and reflexive, but it is not transitive. Further- 
more, note that (trivially) P <ir Q implies (P, Q) € Ti. 

Proposition 2.3 // (P, Q) G H, then P <st Q. 

Proof. For P = Q the statement is trivial. Hence, now assume P ^ Q. Let xq be as in 
the definition of H. We will show that there exists an xi € M such that l{x) > 1 for x < xi 
and £{x) < 1 for x > xi. Clearly, this implies oo,x]) > Q{{—oo,x]) for x < xi and 
P{{x,oo)) < Q{{x,oo)) for x > xi. Combining these two inequalities, we get P <st Q- 

In order to establish the existence of such an xi, we distinguish three cases. 

Case 1. If £ is monotone decreasing, then the statement is trivial. 

Case 2. Assume that (. is monotone decreasing on (— oo, xq] and monotone increasing on 
[xo,oo). Hence £(x) > i'(xo) for all x G R which implies 1{xq) < 1 unless £{x) = 1 for 
all X € M which was ruled out by the assumption P ^ Q. By assumption (2.2), we have 
£{x) < 1 for all x > xq. Now take xi = sup{x : i{x) > 1} < xq. 

Case 3. Assume that i is monotone increasing on (— oo,xo]. By assumption (2.1), we 
have (.{xq) > 1, £{x) > 1 for all x < xq and £ is monotone decreasing on [xq, oo). Choose 
xi = inf{x > xo : £{x) < 1}. □ 

In Sections 2.2 - 2.4 we show that any two binomial distributions, negative binomial 
distributions and hypergeometric distributions with the same sample size parameter, re- 
spectively, have half monotone likelihood ratios. For hypergeometric distributions, we can 
show this also under the assumptions of Theorem 1 (c) . For other distributions, this method 
is not applicable in such generality. For example, hyp4oo^509,5oo ^yP3io,7io,700 do not 
have half monotone likelihood ratios. In fact, the likelihood ratio is increasing on {0, 1, 2} 
(with max;imal value > 1), decreasing on {2, ... , 150} and increasing on {150, . . . , 400} (to 
values > 1). These distributions are not stochastically ordered as 



— — — — is monotone (increasing or decreasing) for k^^ <k <k* . 
That is, (1.7), (1.9) and (2.3) imply (P,Q) G %. 




(2.3) 



O 



hyP400,509,50o({0' 



k}) < hyP3io,7io,70o({0, 



k}) for A; < 44 



and 



hyP400,509,50o({Oi ■■■,k})> hyp3io,7io,70o({0> • • • , fc}) for > 45. 
On the other hand, it is simple to check numerically that hyp^Qo^ioo,i8 ^st iiyP2i,23,22 

that hyPioo,100,18 T^hmlr IiyP21,23,22- 



but 
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It is tempting to try this method also to get a necessary condition for bn,p < hyp^ with 
m ^ n. However, here in general, we do not have hypg^^^ ~hmir ^n,p as the following 
example illustrates. Let i{k) = hyp2i^23,22({^})/&i8,0.5i06({^})- Then ^(0) = 0.0000042 
and £ increases monotonically to ^(13) = 2.05. Then it decreases to ^(17) = 0.997 and 
finally takes the value ^(18) = 1.006. Although condition (ii) of Definition 2.1 is fulfilled, 
we do not have (hyp2i_23,22> &i8,o.5i06) e %. In fact, hyp2i 23,22 and 6i8,o.5i06 are not 
stochastically ordered since 

hyP21,23,22({0}) - bl8,0.5106({0}) = -2.5 ■ 10"^ < 

and 

hyP2i,23,22({0, . . . , 16}) - 6i8,o.5i06({0, • • • , 16}) = 8.4 • 10-« > 0. 

It is easy to check that 618,1/2 <st liyp2i,23,22 although hyp2i^23,22 T^hmir 618,1/2- In fact, the 
likelihood quotient l{k) increases for k < 13, then decreases to ^(17) = 1.393 and finally 
takes the value i{18) = 1.467. 



2.2 Proof of Theorem 1(a): Binomial Distributions 

Lemma 2.4 Let ni,n2 G N and pi,p2 £ [0,1]- Then bni,pi ~hmir 6^2,^2/ ^^^^ ^ni,pi 
and bn2,p2 have half monotone likelihood ratios. 

Proof. The cases pi G {0, 1} or p2 G {0, 1} are trivial. Hence, now assume ^1,^*2 G (0, 1). 
Furthermore, due to the symmetry of ~hmir we may assume without loss of generality 
ni < 712. 

Denote by 



the likelihood ratio. We compute 

e{k + i) _ m-k pi(l -P2) 
£{k) n2 — k (1 - pi)p2 



for A; = 0, . . . ,ni — 1. 



Since ni < n2, we see that A; h-)- (.(k + l)/l{k) is monotone decreasing and hence £{k) is 
first monotone increasing and then monotone decreasing. □ 

Proof of Theorem 1(a). We only have to show sufficiency of the tail conditions (1.10) 
and (1.11) for 6ni,pi <st 6n2,P2- Proposition 2.3 and Lemma 2.4, it remains to show 
(1.7) and (1.9). Since we have 712 > ni, we have A;^, = and k* = n2- Since p2 > pi, we get 
i{n2) = 6ni,pi({n2})/5„2,p2({™2}) < 1; that is, (1.9) holds. Furthermore, by assumption, 
we have 

bn,,pAm = (1 -Pir > (1 -P2)"^ = 6n2,p2({0}) 

which implies (1.7). □ 
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2.3 Proof of Theorem 1(b): Negative Binomial Distributions 

Lemma 2.5 Let ri,r2 > andpi,p2 G (0,1]. Then Vi,pi ~hmlr K2,P2> ^^"^ ^n,pi "'^^ 
^'^^fi /la// monotone likelihood ratios. 

Proof. The cases pi = 1 or p2 = 1 are trivial. Hence, now assume pi,P2 & (0)1)- 
Furthermore, due to the symmetry of ~hmir we may assume without loss of generahty 

ri < r2. 

Denote by 

br2,P2{{k}) 



the likelihood ratio. We compute 

i{k + l) _n + k 1-pi 
£{k) ~ r2 + k 1-P2 



for k e No. 



Since ri < r2, we see that £{k + l)/£{k) is monotone increasing. This imphes that £(k) is 
first monotone decreasing and then monotone increasing; that is ~hmir ^V2,P2- ^ 

Proof of Theorem 1(b). Wc only have to show sufficiency of the tail conditions (1.12) 
and (1.13) for h~^ p^ <st b~^,p2- By Proposition 2.3 and Lemma 2.5, it remains to show 
show (1.7) and (1.9). Since pi > p2, we get 

k^oo ybr2,p2{{k}) J 1-P2 

which implies (1.9). Furthermore, by assumption, we have 

KpSm = i^-pip > ii-P2r = v„..({o}) 

which implies (1.7). □ 



2.4 Proof of Theorem 1(c): Hypergeometric Distributions 

The left tail condition (1.16) imphes (ni — Wi)~^ < (ri2 — W2)^ and the right tail condition 
(1.17) implies ni A Bi < n2 A B2. Furthermore, trivially we have Pi <st P2 and even 

Pi <ir P2 if 

ni A < (n2 - W2)+ (2.4) 

(and hence this condition imphes the left and right tail condition). Hence in this case, 
(Pi,P2) G 7i. Since this shows the theorem in the case (2.4), we may henceforth exclude 
this case. That is, we assume 

(n2- W2)+ <niA5i. (2.5) 
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Lemma 2.6 Assume that (1-15) holds or that (1-17) and (1-14) hold. Then we have 

hyPBi,iyi,ni ~hmlr hyp^^ ,W2,n2' ^^^^ ^yPBi,Wi,ni 

and hypB2 ,W2,n2 have half-monotone 

likelihood ratios. 

Proof. By the discussion preceeding this lemma, we may assume 

(m - Wi)+ < (n2 - W2)+ < m A Si < 712 A B2. (2.6) 



Now let 



Further, let 



A:+ := {n2 - ^^2)+ > A;* = (ni - Wi)+ and 
A;+:=SiAni < A;* = B2 A n2. 



,B2,n2 m) 
with the convention 1/0 = 00. We have 

= 00, if A;* < A; < A;+, 
£{k)< g(0,oo), if A;+ < A; < A;+, 
= 0, if A;+ < A: < A;*. 

For A; G / := {A:* V (A;+ - 1), . . . , A:* A (A+ + 1)}, we have 

(k) — ^(^ + ^) _ -^1 - ^2 - n2 + 1 + A: m-k 
l{k) ~ B2-k Wi-m + l + k n2-k' 

(Note that q{k+ - 1) = if A;+ > k^.) 

We are done if we can show that q{k) — l changes the sign at most in /. In fact, this implies 
that, q{k) can cross 1 at most once. This in turn implies that i is half-monotone on I (in 
the sense of Definition 2.1(i)). Since i is constant on {A;*, . . . , A;+ — 1} (taking the value 
00) and constant on {fe"*" + 1, . . . , A:*} (taking the value 0), we infer that I is half-monotone 
on {A:*, ... , k*}. Hence, by Remark 2.2, we get hyp^^ „^ ~hmlr '^T£>B2,W2,n2- 

In order to show that q{k) — 1 changes the sign at most once, we have to rely on the 
assumption (1.14) or (1.15). 

Assume first that (1.15) holds. There are nine cases to consider and we start with the 
case ui =n2. Then for k E I, we have 

. . _ Bi{W2 - n2 + 1) - B2{Wi - m + 1) + [Bi + W1-B2- W2]k 
' ~ {B2-k)iWi-ni + l + k) 

Note that the numerator is affine linear and the denominator is positive for k & I. Hence 
g(A;) — 1 changes its sign at most once. The other eight cases ni = B2, n2 = Bi, Bi = B2 
and so on are similar resulting in an affine numerator and a denominator without sign 
change. 
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Now assume that (1.14) holds but (1.15) does not hold. Then A;+ < k* and 

_ p{k) 02 fc^ + ai x + oo 

^ ~ (52 - k){Wi - m + 1 + k){n2 - k) 

with 

ao = BiniW2 — Binin2 + B\ni — B2n2Wi + B2n2n\ — B2n2 
ai = — B1W2 + Bin2 — Bi + B\n\ — n\W2 — ni 
+ B2W1 - B2n\ + B2- B2n2 + n2Wi + 712 

02=^2 + ^2-51-^1. 

For A; G / the denominator is positive. We have 

g(/c+) - 1 = -1 

and hence p(fc+) < 0. Since p is at most quadratic, condition (1.14) (that is, 02 > 0) 
implies that p changes its sign at most once on (—00, k'^\. Hence, again q{x) — 1 changes 
its sign at most once. □ 

Proof of Theorem 1(c). We only have to show sufficiency of the tail conditions (1.16) 
and (1.17) for ^yVBi,Wi,n ^st hypB2,vF2,n- However, this is an immediate consequence of 
Proposition 2.3 and Lemma 2.5. □ 



2.5 Proof of Theorem 1(d): Hypergeometric versus Binomial 

For m/\B > n, the implications are clear. Hence, without loss of generality, we may and 
will assume m <n and B < n. 

Denoting the likelihood ratio by i{k) = ^yPB,w,m{{^})/bn,p{{k}), we get that 

i{k + l) {B-k){m-k) 1-p 



l{k) {W - m + k){n - k) p 



for A; = 0, . . . , (5 A m) - 1 



is monotone decreasing and hence ^yY>B,w,m ~hmir It is a simple exercise to check 

that 

hyPB,vK,m({0})/&n,p({0}) > 1 =^ hyps ty„,({n})/6n,p({n}) < 1 

and 

^YVB,w,m{{'m})/bm,p{{'rn}) ^ 1 =^ hyPB,w,m({0})/W({0}) < 1- 
Hence the left tail condition (1.18) implies {}^yY>B,w,mi^n,p) G 'H and thus ^yY>B,w,m — st 
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2.6 Proof of Theorem 1(e): Binomial versus hypergeometric 

The proof of Theorem 1(e) is quite similar to the one of part (d). In fact, it is easy 
to see that the right tail tail condition (1.20) implies {bm,p,iwPB,w,m) ^ ^ thus 

^yPB,W,m >st bm,p- □ 



2.7 Proof of Theorem 1(f): Binomial versus Poisson 

Clearly, the left tail condition is necessary for bn,p <st PoU- 

Hence now assume that that the left tail condition (1.21) holds. Let 

'^^^ - Poi.({fc}) 

and compute 

^(fc + 1) TP I M f i. n 

^^ = J^^^{n-k) for fc = 0,...,n. 

Hence l{k + l)/£{k) is monotone decreasing and thus bn,p ~hmir PoIa- Since the right 
tail condition holds trivially and the left tail condition holds by assumption, we infer 
(6„^p, Poi^) G Ti and thus, by Proposition 2.3, we get <st PoIa. C 

Of course, this result is trivial, since we can even easily derive a coupling: Let A = 
— Iog(l —p)< X/n and let Xo, Xi, . . . , X„ be independent with Xi ~ Poij^ for i = 1, . . . , n 
and Xq ~ Poi^_^j^. Then 

S := Xo + Xi + . . . + Xn >T := {Xi Al) + . . . + {Xn M) a.s. 

and S ~ PoiA, T ~ bn,p- 

2.8 Proof of Theorem 1(g): Poisson versus negative binomial 

Clearly, the left tail condition is necessary for PoIa <st b^^p. Furthermore, it is easy to see 
that the right tail condition always holds. 

Hence now assume that that the left tail condition (1.22) holds. Let 

br,p{{k}) 

and compute 

Hence l{k + l)/i{k) is monotone decreasing and thus Poia ~hmir b~p. Since the right 
tail condition holds trivially and the left tail condition holds by assumption, we infer 
(PoiA,6~p) G H and thus, by Proposition 2.3, we get PoIa <st b~p. □ 
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3 Method 2: Coupling 



In this section, we give a proof of Theorem 1(a) that provides an exphcit couphng of 
two random variables A^^ ~ ^n^,pj such that iV^ ^ A^2 almost surely. Clearly, this implies 

bni,pi ^st bn2,p2- 

Proof of Theorem 1(a). We only have to show sufficiency of the tail conditions (1-10) 
and (1.11) for 6„i,pi <st &n2,P2- Hence, assume (1.10) and (1.11). By (1.1), it suffices to 
consider the smallest p2 such that (1.10) holds. That is, we may assume 



(1-^>1)"^ = (1-P2) 



n2 



(3.1) 



Define 

A := -ni log(l -pi) = -n2 log(l -^2)- 

For i = 1, 2, let {Xi{l),l = 1, . . . , n^) be a family of independent Poisson random variables 
with parameter A/n^. (Note that we do not require that Xi{li) and X2{l2) be independent.) 
Then 

Ni = #{l: Xi{l)>l} ~ 6„^,p^. 
The idea is to construct a coupling of the Xi(l) such that 

Ni < N2 almost surely. (3.2) 

This clearly implies bni,pi <st ^n2,P2- 

Let T be a Poisson random variable with parameter A. Assume that for i = 1,2, the 
family (Fi^k, G N) of random variables is independent and independent of T and each 
-Pj^fe is uniformly distributed on {1, . . . , nj}. Then 



Xi{l):=#{k<T: Fi,k = l}, 1 = 1,..., 



rii. 



arc independent and Poisson distributed with parameter A/n^. The remaining task is to 
construct the families (-Fi,fc, A; € N) such that (3.2) holds. 

For Ai C {1, . . . , rii} let = #Ai and ^4^ = {1, . . . , rii} \ A,;. For ri G {1, . . . , ni} and 
r2 G {1, . . . ,n2} define (/"^^'^^(ri, r2) depending on whether ai < 02 or a\ > 02: 

If ai < a2, then let 

g^i'^^(ri,r2) 



1 



If ai > 02, then let 



^Ai,A2 



{ri,r2) 



ain2 
ain2 — a2ni 
ainin2{n2 - 02) '' 



(n2 — a2)ni' 
0, 



nin2 

if ri G Ai and r2 G A2, 

if ri G Ai and r2 G 

if ri G and r2 G 
otherwise. 
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Let 

^•3-i=l 

denote the i-th marginal of q"^^'^^. Clearly, for ai < 02 we have qf^'^^{ri) = l/rii for 
i = 1,2 and rj G {1, . . . , rii}. Now assume ai > 02- Then for ri G Ai, 

Ai.Aa/ N "2 , . ^ ain2-a2ni 1 

9i (ri) = + (n2 - 02) r = — . 

01^2 ainin2{n2 — a2) ni 



On the other hand, for ri & A^, 

gf^'^^(ri) = (n2 - a2 



{n2 — a2)ni ni ' 
Analogously, we get for all r2 G {1, . . . , n2} 

q^''^^{r2) = -. 

"2 

Thus, independently of the choice of Ai and A2, the marginals of g^.^ ^j^g uniform 

distributions on {1, . . . , ni} and {1, . . . , n2}, respectively. Now, define Aq^i = ^0,2 = 0- 
Inductively, choose a pair -Ffe,2) G {1, . . . , ni} x {1, . . . , 712} at random according to 

qAk-i,i,Ak-i,2 and define j = U Clearly, ot,? = iVj, hence it is enough to 

show that 

«fc,i < ak,2 for all k G Nq. (3.3) 

For k = 0, (3.3) holds trivially. Now we assume that (3.3) holds for — 1 and we show 
that it also holds for A;. If ak-i^i < 0,^-1,2, then 

< afc-1,1 + 1 < ak-1,2 < ak,2- 

If = afc-1,2, then either F^^i G which implies 0^,1 = ak-i,i = afe_i,2 < afe,2, 

or Fk^i G i- In the latter case, according to the definition of q"^^'^^, we have Fk,2 G 
^fc-1,2' hence ' 

Ofe,i = + 1 = ak-1,2 + 1 = ak,2- n 



4 Method 3: Markov Chains 

The aim of this section is to give a proof of Theorem 1 (a) that uses the interpretation of the 
binomial distribution as the distribution of nonempty boxes when we throw successively 
balls into n boxes. In contrast to Method 2, here we do not construct an explicit coupling 
of the random variables but use Markov chains in order to get a very quick and elementary 
proof that could be taught in any first course on probability theory. 

Let n,t G N. Assume that we throw t balls independently into n boxes with numbers 
1, . . . , n and denote by N^^t the number of nonempty boxes. Let T be random and Poisson 
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distributed with parameter A = — nlog(l — p). Assume that T is independent of the 

numbers N^^ti i = 1,2, .... As indicated in Section 3, the number N^^t is binomially 
distributed with parameters n and p. Hence, in order to show Theorem 1(a), it is enough 
to show the following proposition. 

Proposition 4.1 For each t eN, the sequence {Nn^t)neN is stochastically increasing. 

Proposition 4.1 is in fact a special case of a more general result where the probabilities pi 
for hitting box i = 1, . . . ,n differ from box to box (see [14]). 

Proof. For each n, {Nn,t)t=o,i,... is a Markov chain on {0, ... , n} with transition matrix 

k/n, if I = k, 
Pn{k,l) = 1 — k/n, if l = k + l, 
0, otherwise. 



Define 



0, 


if 


k<l- 


1, 


k/n, 


if 


k = l- 


1, 


1, 


if 


k>l- 


1, 



and note that hn,i (k) is increasing in k and n. 

Let m < n and note that trivially = is stochastically smaller than iV„_o = 0- By 

induction, we show that Nj^^t <st Nn,t for all t G Nq. Indeed, for every £ G {0, . . . ,m}, by 
the induction hypothesis and due to the monotonicity of (n, k) i->- hn,i{k), we have 

P[Nm,t+l >l]= Hhrr,,l{Nm,t)] < ^h„^{Nn,t)] < Ef/l^/AT^^t)] = P[Ni,t+l > I]- 

This however implies that Nm,t+i is stochastically smaller than Nn^t+i- ^ 



5 Method 4: Analytic Proof 

The aim of this section is to give proofs of Theorem 1(a) and (b) that rely on changing 
the parameter p of the distributions continuously and using calculus to compute the de- 
pendence of the distributions on this parameter. Although the proofs for (a) and (b) are 
rather similar, we felt that it is no loss in efficiency to give two separate proofs. 

5.1 Proof of Theorem 1(a): Binomial Distributions 

We only have to show sufficiency of the tail conditions (1.10) and (1.11) for feni,pi <st ^n2,P2- 
By (1.1), we only have to consider the case ni < n2 and (1 — pi)"^ = (1 — ^2)"^- 
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Let R := ^ > 1 and define the map 

tt: [0,1] ^[0,1], p^l-{l-pf. (5.1) 

Denote by 7r'(p) = i?(l — p)^~^ the derivative of tt. 
Forn G N, p G (0, 1) and Ac{0,...,n} define 

Computing the derivative for A = {k}, k = 0, . . . ,n, explicitly yields 

b'n,pm) = -n[bn-iA{k}) - bn-iA{k - 1})] 

(where bn-i,p{{—l}) = and boA{k}) = 1 iff = 0). Hence building a telescope sum, we 

obtain 

b'^AiO, ...,k}) = -nbn-i,pm) for n G N, p G [0, 1], k G Nq. (5.2) 

For A; G No, define the map 

/fe:[0,l]^R, p^6„,,^(p)({0,...,A:})-6„^,p({0,...,/c}). (5.3) 

As 7r(p2) = Pi, we have to show that fk{P2) > for all k. Obviously, only the case 
A;G{l,...,ni — l}is nontrivial, and we fix such a k for the rest of this proof. 

Since 7r(0) = and 7r(l) = 1, we have /fe(0) = /fc(l) = 0. As fk is differentiable in (0, 1) 
and continuous on [0, 1], it is enough to show that 

fk{p) is strictly positive in a neighbourhood of (5.4) 

and 

fkip) — most one p G (0, 1). (5.5) 

Using (5.2), we compute the derivative 

f'kip) = 7r'(p)6;^,^(p)({0,...,fc})-6;^,,({0,...,fc}) 

= ?^2^-l,p({^}) - ^l7r'(p)^-l,7r(p)({fc}) 

= n,(^'''-y''{i-pr-'-'' 

- niRil-pf~'(^'''~ ^) (1 - (1 -p)«)^'(l -p)«(-i-i-'=) 

\fn2-l\f P Y fn,-l\ f l-{l-p)R \' 

= ■[[ k )[t^p) -[ k J 1^13^ 

Hence (5.4) follows from (recall R = n2/n\ > 1) 
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Now for p G (0, 1), we have /^(p) = if and only if 

g{p) := p(l-p)^-^-a- (l-(l-p)^) 

where 



a :- 




Since /^(p) > for sufficiently small p > 0, also g{p) > for these p. Hence in order to 
show that g{p) = for at most one p G (0, 1), it is enough to show that g'ip) = for at 
most one p G (0, 1). To this end we compute 

g'{p) = (1 - pf-^ [l-aR-{l- a)Rp] . 

Hence g'{p) = exactly for p = 1 and p = (jEf^- this shows (5.5), the proof is 
complete. □ 



5.2 Proof of Theorem 1(b): Negative Binomial Distributions 

We only have to show sufficiency of the tail conditions (1.12) and (1.13) for 6~ <st b~^,p2- 
Recall that if ri < r2 and Xi and X2 are independent random variables with distributions 
b^^ p and 6~ p, respectively, then Xi + X2 has distribution 6r-2,p- That is 6~ ^ <st 6~ ^ 
if and only if ri < r2- Hence we may assume ri > r2- 

Step 1. By a simple computation, we get 

^b-^m ...,k-i}) = k(^~^^ (-1)^(1 - p)^- y-i. (5.6) 

In fact, multiplying both side in (5.6) by p~^, as functions of r, 

p-r±b-p{{0,...,k-l}) and (-1)^(1 -p)'=-V^ 

are polynomials. Hence, it is enough to check (5.6) for all r € N. Either by a direct 
computation or by appealing to the waiting time interpretation that in a Bernoulli chain 
with success probability p, b~p is the distribution of the number of failures before the nth 
success occurs, we get 

b-p{{0, ...,k-l})= bn+k-i,i-p{{0, ...,k- 1}). 

Hence by (5.2), we get 

^b-p{{0, ...,k-l}) = in + k- l)6„+fc_2,i-p({A; - 1}) = k (^'^^ (-1)^(1 - p)'=- V"' 

as desired. 
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Step 2. Let R = r2/ri<l. Fix A; G N. For p G (0, 1] define 

fip) ■■= K,,p^m ...,k-i})- 6- ,^({0, . . . , - 1}). 

It is enough to show that f{p) > for all p G (0, 1]. 

Clearly, /(I) = and linipj^g f{p) = 0. Hence it is enough to show that f'{p) > for p 
sufhciently small and f'{p) = for at most one p G (0, 1). By (5.6), we have 



f'{p) = kp 



r2-l 



ri + k — 1 
k 



^Ril-p"")"-' - 



R,k-i (r2 + k-l 



k 



k-l 



Hence 

Define 
where 



pio kp'^'^-^ 



g{p) :=c(l-p^) 



r2 + k - 1 
k 



> 0. 



i/(fc-i) 



c : 



Clearly, g{p) = if and only if f'{p) = 0. It is easy to see that g{l) =0 and g'{p) = if 
and only if p = (ci?)^/^-^'"^^. This implies that g{p) = for at most one p G (0, 1). □ 



6 Method 5: Infinite Divisibility 

In this section, for infinitely divisible distributions on [0, oo), we derive a sufficient criterion 
(Lemma 6.1) for stochastic ordering in terms of the Levy measures. We use this criterion 
to give a short proof of Theorem 1 for negative binomial distributions. 

6.1 Stochcistic Ordering of Infinitely Divisibly Laws 

An infinitely divisible distribution P on [0, oo) is characterized by the deterministic part 
ap € [0, oo) and the Levy measure up on (0, oo). The connection is given via the Levy- 
Khinchin formula (see, e.g., [3, Theorem 16.14]) 

- log (^J e"*^ P(dx) j =apt + J (l - e"*^) up{dx) for all t > 0. (6.1) 

If /J, and v are two measures on arbitrary measurable spaces, we write /x < if n{A) < I'iA) 
for every measurable set A. If X is a nonnegative infinitely divisible random variables with 
distribution Px, we write i^x = i^Fx ax = ap^ for the corresponding characteristics. 
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If X and Y are independent, then i^x+y = + ^ and ax-\-Y = ctx + ctY- Thus for 
infinitely divisible distributions P and Q, we have 

oep < ag and vp < vq =^ P <st Q- (6.2) 

(The opposite implication is not true.) For example, the negative binomial distribution 
is infinitely divisible with vanishing deterministic part and with Levy measure v^^p 
concentrated on N and given by 

VrAik}) = Hm X-%r,vm) = r^-^-^ for k G N. (6.3) 
In fact, a direct computation yields 

oo oo 

- log ^ h-^{{k})e-'^ = r log {p-\\ - (1 - p)e-*)) = J] u^^ikW ' ■ 

k=0 k=l 

Note that i'ri,p\ ^ T^r2,P2 if Pi — P2 and ri < r2 or if ri = r2 and pi > P2- Hence, similarly 
as for the binomial distribution, by (6.2), we get the two relations (for all p G (0, 1) and 
r > 0) 

b'l^p <st 6r2,p ^ ri<r2 (6.4) 

and 

K,pi<stK,p2 Pi>P2- (6.5) 

For the case where both parameters differ, we need a more subtle criterion. Let fii and 
/Lt2 be two measures on (0, oo) with //j([x, oo)) < oo for all x £ (0, oo), i = 1, 2. Extending 
the notion of stochastic ordering to such measures, we write <st 1^2 if 

lii{[x,oo)) < /X2([a;,oo)) for all x € (0, oo). (6-6) 

Note that fii < 112 implies /xi <st A*2- 

For a multi-dimensional version of the following lemma, see [9, Theorem 2.2]. 

Lemma 6.1 Let Pi, i = 1,2, be infinitely divisible distributions on [0,oo) with determin- 
istic parts OLi and Levy measures fj. Assume that 

ai < 012 and vi <st V2. 

Then there exist random variables Z\ and Z2 with distributions Pi and P2, respectively, 
such that Z\ < Z2 almost surely. In particular, we have Pi <st P2 ■ 

Proof. It is enough to consider the situation ai = 0:2 = 0. Let 

Gi{x) = Vidx, 00)) for all x G (0, 00) 
and define the inverse function 

Gr\y) := inf (a; > : Gi{x) < y} for y G (0,oo). 
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Let X be a Poisson point process on (0, oo) with rate 1. That is, X is an integer valued 
random measure on (0, oo), for bounded measurable sets A, X{A) is Poisson distributed 
with the Lebesgue measure of A as parameter, and for pairwise disjoint sets, the values of 
X are independent random variables. Define 

Zr.= J G-\y)X{dy), i = l,2. 

Then for t > 0, we have (compare [3, Theorem 24.14]) 

- logE[e-*^>] = (^1- e-*G."'(f)) dy = J [1- e"*^) Ui{dy) 



■log 



Thus Zi has distribution Pj. By the assumption Gi < G2, we have ^ < G2 ^ and hence 
Zi < Z2 almost surely. □ 



6.2 Proof of Theorem 1(b) 

We only have to show sufficiency of the tail conditions (1.12) and (1.13) for <st ^2,^2' 

Recall from (6.3) that the negative binomial distribution 6~ p. is infinitely divisible with 
deterministic part a^^ = and Levy measure Vn pi being concentrated on N and given 

by 

^n,n{{k}) = ^i^^—jp^ all keN. 
As pi > p2, we have 1^7-1,^1 <ir ^r2,P2'j that is, the map 

A; H-^ 



''r,,pj{{k}) _ ri (l-pi) 



,P2 

is monotone decreasing. This implies that 

k ^ rh(k) ■= '^r„pA{k,k + l,...}) ^ n E^iil^iLlZll! 

iyr2,p2{{k,k+i,...}) r2j:Zki-'i^-P2y 

is monotone decreasing. By the assumption p^ > j^-i , we have 

( ^ < 1. 

r2 log(p2) 

Hence ^(/c) < 1 for all /c G N; that is Vt\,p\ <st ^vi,pi thus ^st ^2,^2 

Lemma 6.1. □ 
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6.3 Proof of Theorem 1(g) 

When viewed from the perspective of infinitely divisible distributions, the statement of 
Theorem 1(g) is trivial. In fact, bj^p is infinitely divisible and the Levy measure i'r,p 
has total mass t'r-,p(N) = — rlog(^?). Since Poi^ is infinitely divisible with Levy measure 
fx = ^(^1, we see that ux <st i'r,p if s^nd only if > p^. Hence, the claim follows using 
Lemma 6.1. □ 
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